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United States Patent m 

Chen 



[54] METHOD AND APPARATUS FOR 

LEARNING IN A NEURAL NETWORK 

[75] Inventor: Kaihu Chen, Shirley, Mass. 

[73] Assignee: Digital Equipment Corporation, 
Maynard, Mass. 

[21] Appl.No.: 724,381 

[22] Filed: Jun.28,1991 

[51] Int. Q.5 G06K 9/62 

[52] U.S. a 382/14; 382/15; 

395/50 

[58] Field of Search 382/14, 15; 364/513; 

371/35; 396/50, 52 

[56] References Cited 

U.S. PATENT DOCUMENTS 
3,950,733 4/1976 Cooper et al 382/15 




US005226092A 



[ii] Patent Number: 5,226,092 
[45] Date of Patent: Jul 6, 1993 

5,063,601 11/1991 Hayduk 382/14 

Primary Examiner— Michael T. Razavi 

Assistant Examiner — Yon Jung 

Attorney, Agent, or Firm— Kenyon & Kenyon 

[57] ABSTRACT 

A method and apparatus for speeding and enhancing 
the "learning" function of a computer configured as a 
multilayered, feed format artificial neural network 
using logistic functions as an activation function. The 
enhanced learning method provides a linear probing 
method for determining local minima values computed 
first along the gradient of the weight space and then 
adjusting the slope and direction of a linear probe line 
after determining the likelihood that a "ravine" has 
been encountered in the terrain of the weight space. 
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US005741980A 
Patent Number: 5,741,980 
[451 Date of Patent: Apn 21, 1998 



United States Patent m 

Hilletal. 

[54] FLOW ANALYSIS SYSTEM AND METHOD 

[75] Inventors: Wayne S, Hill. Westborough; Bruce N. 
Barck. Franklin, both of Mass. 

[73] Assignee: Foster-Miller, Inc.. Waltham. Mass. 

[21] AppL No.: 784,737 
[22] Filed: Jan. 16, 1997 

Related ILS. Application Data 

[63] Ccotonuauon-in part of Ser No. 333,213, Nov. 2, 1994, Put 
No. 5,600,073. 

[51] Int CL 6 G01F 1/74 

[52] VS. CL 73/861.04 

[58] Field of Search 73/&61.04. 29.01, 

73/23.2, 24.01.659. 30.03 

[56] References Cited 

U.S. PATENT DOCUMENTS 

H60S 3/1989 Goolsby 367/89 

3392,572 7/1968 Brawn 73/29.01 



4,576,036 3/1986 Huang et at 73/29.01 

4,688v418 8/1987 Cheunh ct al. 73/29.01 

5390,547 2/1995 Liu 737861.04 

5,419497 5/1995 Ogi et al 73/659 

5,600,073 2/1997 Hill , 73/861.04 

Primary Examiner— Richard Chilcot 

Assistant Examiner— Jewel Artis 

Aftome); A;e/if, <?r Firm— Iandiorio & Teska 

[57] ABSTRACT 

A non-invasive flow analysis system and method wherein a 
sensor, such as an acoustic sensor, is coupled to a conduit for 
transmitting a signal which varies depending on the char- 
acteristics of the flow in the conduit. The signal is amplified 
and there is a filter, responsive to the sensor signal, and tuned 
to pass a narrow band of frequencies proximate the resonant 
frequency of the sensor. A demodulator generates an ampli- 
tude envelope of the filtered signal and a number of flow 
indicator quantities are calculated based on variations in 
amplitude of the amplitude envelope. A neural network, or 
its equivalent is then used to determine the flow rate of the 
flow in the conduit based on the flow indicator quantities. 

50 Claims, 5 Drawing Sheets 




United States Patent [19] 

Ogata et al. 



US005313559A 

[li] Patent Number: 5,313,559 
[45] Date of Patent: May 17, 1994 



[54] METHOD OF AND SYSTEM FOR 

CONTROLLING LEARNING IN NEURAL 
NETWORK 

[75] Inventors: Hisao Ogata, Kokubunji; Hiroshi 
Sakou, Shiki; Masahlro Abe, Iruma; 
Junichi Higashino, Kodaira, all of 
Japan 

[73] Assignee: Hitachi, Ltd,, Tokyo, Japan 

[21] Appl. No.: 833,127 

[22] Filed: Feb. 10, 1992 

[30] Foreign Application Priority Data 

Feb. 15, 1991 [JP] Japan 3-042957 

[51] Int. CI.' G06T 15/18 

[52] U.S.Q 395/23; 395/76 

[58] Field of Search 395/23, 76 

[56] References Cited 

U.S. PATENT DOCUMENTS 

4,530,054 7/1985 Hamstra et al 395/550 

4,823,310 4/1989 Grand 395/600 

4,941,122 7/1990 Weideman 364/807 

5,033,006 7/1991 Ishizuka et al 364/513 

5,088,034 2/1992 lhara et al 364/DIG. 1 

5,121,467 6/1992 Skeirik 395/11 

5,142,665 8/1992 Brgus 395/21 

5,168,550 12/1992 Sakaue et al 395/23 

FOREIGN PATENT DOCUMENTS 

2-231670 9/1990 Japan . 

2-277180 11/1990 Japan . 

3-18964 1/1991 Japan . 

3- 36659 2/1991 Japan . 

4- 60752 2/1992 Japan . 

OTHER PUBLICATIONS 

Caudill, "Neural Network Training Tips and Tech- 
niques", Al Expert, Jan. 1991, pp. 56-61. 
Vanderplaats, "Numerical Optimization Techniques for 
Emgineering Design,'* McGraw Hill, 1984. 
Nievergett et al, "Sites, Modes, and Trails: Telling the 



User of an Interactive System Where He is, What He 
Can Do, and How He Can Get to Places", in Readings 
in Human-Computer Interaction: A Multidisciplinary 
Approach, Baecker et al eds, 1987, pp. 438-441. 
Luenberger, "Linear and NonLinear Prograniming", 
Second Edition, Addison-Wesley, 1984, pp. 191-192, 
382-383. 

McClelland et al., Explorations in Parallel Distributed 
Processing, MIT Press, 1988, 2, 3, 121-152, 245-262, 
303, 304. 

Hillman, D., "Software Review-Neuro Shell," Al Ex- 
pert, Sep. 1990, 61, 62, 64. 

Takingi et al., "Fast Learning Algorithm for Artificial 
Neural Network Using Non-Linear Optimization 
Method," IEEE Spring Conf., 1989, 7-305-7-306. 

Primary Examiner— Michael R, Fleming 
Assistant Examiner— Robert W. Downs 
Attorney, Agent, or Firm — Fay, Sharpe, Beall, Fagan, 
Minnich & McKee 



[57] 



ABSTRACT 



A learning control method reduces overall learning 
time by displaying data related to an appropriate deter- 
mination of learning protraction and a proper restoring 
method. Prior to initiating the learning, the user is in- 
quired about the current problem and a problem data set 
representing items associated with the problem is ob- 
tained. Evaluation data indicating a state of learning 
obtained during the learning on the current problem is 
sequentially stored and displayed. When there is a high 
possibility of learning protraction during the learning, a 
message informing the user is displayed. When the 
learning is stopped by the user in this case, the problem 
data set and evaluation data set are stored. Then, a list of 
restoring methods is displayed and a particular restor- 
ing method is selected by the user once the learning is 
stopped. The learning is restarted on the current prob- 
lem in accordance with the selected restoring method. 
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US005550761A 

[li] Patent Number: 5,550,761 
[45] Date of Patent: Aug. 27, 1996 



[54] METHOD FOR MODELLING MULTIPHASE 
FLOWS IN PIPELINES 

[75] Inventors: Christian Pauchon, St 

Germain-En-Laye; Gilles Ferschneider, 
St Symphorien D'Ozon; Daniel Ferre, 
Sautron, all of France 

[73] Assignees: Institut Francais du Petrole, Rueil 
Malmaison, France; Total, Puteaux, 
France; Elf Aquitaine, Courbevoie, 
France 

[21] Appl. No.: 193,457 
[22] Filed: Feb. 8, 1994 

[51] Int Cl. e G01F 22/00 

[52] VJS.CI 364/578; 73/861 .04; 73/61.44 

[58] Field of Search 364/476, 803, 

364/578, 510, 496; 73/861.04, 61.44; 166/250 

[56] References Cited 

U.S. PATENT DOCUMENTS 

4,534,003 8/1995 Manzione 364/476 

4,559,610 12/1985 Sparks et al 364/803 

4,683,759 8/1987 Skarsvaag et al 73/861.04 

4,875,178 10/1989 Cook 364/578 

5,031,108 7/1991 Fujitaetal 364/476 

5,031,127 7/1991 Fujitaetal 364/476 

5,051,922 9/1991 Tbral et al 364/510 

5,072,404 12/1991 Schmilzer et al 364/510 



5,095,983 3/1992 Magnani 166/250 

5,099,697 3/1992 Agar 73/861.04 

5,255,212 10/1993 Kondoh et al 364/578 

5,287,752 2/1994 Den Boer 73/861.04 

5,315,530 5/1994 Gerhardt et al 364/510 

5,414,641 5/1995 Shinoaki et al 364/510 

Primary Examiner— Kevin J. Teska 

Assistant Examiner — Russell W. Frejd 

Attorney, Agent, or Firm-— Antonelli, Terry, Stout & Kraus 

[57] ABSTRACT 

A unified hydraulic model has been developed by the 
method according to the invention which is applicable to any 
slope and diameter of pipeline and can handle most of the 
steady state as well as transient multiphase flow regimes 
encountered in practice. The new modelling method differ- 
entiates two types of flow patterns: separated flow patterns 
(stratified or annular) and dispersed flow patterns. Intermit- 
tent flow patterns (slug, churn flow) are a combination of 
these two patterns. The same concept has been successfully 
applied for transition criteria between different flow 
regimes, insuring continuity of the solutions across the 
transitions. This requirement is very important for simulat- 
ing transient phenomena. The transient resolution is 
achieved by an explicit time advancing scheme. The advan- 
tages of the method are; its ability to follow wave front 
propagation, an easy implementation for the resolution of 
complex pipeline networks. The performance of the result- 
ing unified hydraulic model is demonstrated using a large 
number of experimental data. 

8 Claims, 5 Drawing Sheets 
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United States Patent [19] [ii] Patent Number: 6,092,919 

Calise et ah [45] Date of Patent: *JuL 25, 2000 



[54] SYSTEM AND METHOD FOR ADAPTIVE 
CONTROL OF UNCERTAIN NONLINEAR 
PROCESSES 

[75] Inventors: Anthony J. Calise, Atlanta, Ga.; 

Byoung-Soo Kim, Taejon Su-gu 
Doonsandong, Rep. of Korea 

[73] Assignee: Guided Systems Technologies, Inc., 

McDonough, Ga. 

[ * ] Notice: This patent issued on a continued pros- 
ecution application filed under 37 CFR 
1.53(d), and is subject to the twenty year 
patent term provisions of 35 U.S.C. 
154(a)(2). 



[21] Appl. No.: 08/510,055 
[22] Filed: Aug. 1, 1995 

[51] Int. CI. 7 G05B 13/02 

[52] U.S. CI 364/148.03; 364/151; 364/162; 

364/424.09; 434/55; 244/194; 244/195 

[58] Field of Search 364/148, 151, 

364/162, 424.088, 424.087, 424.089, 424.09, 
972.4, 424.097; 395/85, 87; 483/11; 434/55; 

244/194, 195 

[56] References Cited 

U.S. PATENT DOCUMENTS 



4,062,508 12/1977 Stephens et al 244/234 

4,197,576 4/1980 Sanchez 364/106 

4,383,299 5/1983 Fischer et al 364/434 

4,466,054 8/1984 Shigemasa et al 364/162 

5,042,752 8/1991 Surauer et al 244/164 

5,099,204 3/1992 Wheatley, III 330/279 

5,113,483 5/1992 Keeler et al 395/23 

5,268,834 12/1993 Sanner et al 364/151 

5,282,261 1/1994 Skeirik 395/22 

5,303,385 4/1994 Hattori et al 395/22 

5,311,421 5/1994 Nomura et al 364/157 

5,313,559 5/1994 Ogata et al 395/23 

5,367,612 11/1994 Bozich et al 395/22 

5,396,415 3/1995 Konar et al .' 364/162 

5,469,265 11/1995 Measure et al 356/419 

5,493,631 2/1996 Huang et al 395/22 

5,541,843 7/1996 Yamaguchi et al 364/426.02 



5,633,987 5/1997 Teng et al 395/22 

OTHER PUBLICATIONS 

"Gaussain Networks for Direct Adaptive Control"; Sanner 
Robert and, Jean-Jacques; IEEE Transactions on Neural 
Networks, vol. 3, No. 6, Nov. 1992, pp. 837-341. 
Hoffmann, "A Neural Feed-Forward Network With A Poly- 
nomial Nonlinearity", IEEE, pp. 49-58, Sep. 02, 1992. 
Ahmed et al., "A Feedforward Neural Network for Arbitrary 
Nonlinea Time Series", IEEE, pp. 11-721 -11-726, 1991. 
Cowan, "Equalization Using Non-Linear Adaptive Cluster- 
ing", IEEE, pp. 17/1-17/3, 1994. 

Casterline et al., "Hydraulic link in a control system", 
IEE/INSPEC, Jul. 1907. 

Primary Examiner — -William Grant 

Assistant Examiner — McDieunel Marc 

Attorney, Agent, or Firm—Morris, Manning & Martin, 

L.L.P. 

[57] ABSTRACT 

A process and neural network architecture for on-line adjust- 
ment of the weights of the neural network in a manner that 
corrects errors made by a nonlinear controller designed 
based on a model for the dynamics of a process under 
control. A computer system is provided for controlling the 
dynamic output response signal of a nonlinear physical 
process, where the physical process is represented by a fixed 
model of the process. The computer system includes a 
controlled device for responding to the output response 
signal of the system. The computer system also includes a 
linear controller for providing a pseudo control signal that is 
based on the fixed model for the process and provides a 
second controller, connected to the linear controller, for 
receiving the pseudo control signal and for providing a 
modified pseudo control signal to correct for the errors made 
in modeling the nonlinearitics in the process. A response 
network is also included as part of the computer system. The 
response network receives the modified pseudo control 
signal and provides the output response signal to the con- 
trolled device. The second controller preferably is a neural 
network. The computer system may include a plurality of 
neural networks with each neural network designated to 
control a selected variable or degree of freedom within the 
system. 

2 Claims, 10 Drawing Sheets 
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